Modeling the evolution of weighted networks 
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We present a general model for the growth of weighted networks in which the structural growth 
is coupled with the edges' weight dynamical evolution. The model is based on a simple weight- 
driven dynamics and a weights' reinforcement mechanism coupled to the local network growth. That 
coupling can be generalized in order to include the effect of additional randomness and non-linearities 
which can be present in real-world networks. The model generates weighted graphs exhibiting the 
statistical properties observed in several real-world systems. In particular, the model yields a non- 
trivial time evolution of vertices properties and scale-free behavior with exponents depending on 
the microscopic parameters characterizing the coupling rules. Very interestingly, the generated 
graphs spontaneously achieve a complex hierarchical architecture characterized by clustering and 
connectivity correlations varying as a function of the vertices' degree. 
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I. INTRODUCTION 

Networked structures appear in a wide array of sys- 
tems belonging to domains as diverse as biology, ecology, 
social sciences, or large information infrastructures such 
as the Internet and the World-Wide Web [lllllll. In 
recent years, many empirical findings have uncovered the 
general occurrence of a complex topological organization 
underlying many of these networks, triggering the inter- 
est of the research community. In particular, small-world 
properties [3 and large fluctuations in the connectivity 
pattern identifying the class of scale-free networks |j 
have been repeatedly observed in real world networks. 
These findings triggered a wealth of theoretical and ex- 
perimental studies devoted to the characterization and 
modeling of these features. These studies have pointed 
out the iinportance of the evolution and growth of net- 
works "3, 4, w| and led to the formulation of a long list 
of models aimed at studying the architecture of complex 
networks and the dynamical processes which are taking 
place on their structure 0J B S HOl • 

So far the research activity on networks has been 
mainly focused on graph in which links are represented as 
binary states, i.e. either present or absent. More recently, 
however, the gathering of more complete data has allowed 
to take into account the variation of the strength of the 
connections between nodes (i.e. the weights of the links), 
providing a more complete representation of some net- 
worked structures in terms of weighted graphs. Indeed, 
this diversity in the interaction intensity is of crucial in- 
terest in real networks. Studies of congestion phenomena 
in Internet implies the knowledge and the characteriza- 
tion of its traffic 4| and the number of passengers in the 
airline networks is obviously a basic information to assess 
the importance of an airline connection [^. IllLll^ . In the 
case of ecological networks 13], recent studies (see [Ijl 
and references cited) highlighted the importance of the 
strength of the predator-prey interaction in ecosystem 



stability. Metabolic reactions also carry fiuxes that are 
essential to the understanding of metabolic networks, as 
shown in [l^. Finally, sociologists [I^ showed already 
some time ago the importance of weak links in social net- 
works. Very interestingly, the analysis of some paradig- 
matic weighted networks have revealed that in addition 
to a complex topological structure, real networks display 
a large heterogeneity in the capacity and intensity of the 
connections. In particular, broad distributions and non- 
trivial correlations between weights and topology were 
observed in different networks [O, [13j 113 • 

From the previous discussion, it appears clearly that 
there is a need for a modeling approach to complex net- 
works that goes beyond the purely topological point. In 
this article, we analyze in detail a general model for the 
evolution of weighted networks that couples the topol- 
ogy and weights dynamical evolution. Vertices entering 
the system draw new edges with an attachment dynam- 
ics driven by the weight properties of existing edges and 
vertices. In addition, in contrast with previous mod- 
els [13, [13 for which weights are statically assigned, we 
allow for the dynamical evolution of weights during the 
growth of the system. This dynamics is inspired by the 
evolution and reinforcements of interactions in natural 
and infrastructure networks. We provide a detailed an- 
alytical and numerical inspection of the model, consid- 
ering different specific mechanisms — homogeneous, het- 
erogeneous, nonlinear — for the evolution of weights (A 
short report of the simplest linear and homogeneous case 
appeared in Ref. (2Qj). The obtained networks display 
heavy-tailed distributions of weight, degree and strength. 
We determine analytically the exponents of the corre- 
sponding power-laws showing that they depend on the 
unique parameter defining the model's dynamics. Inter- 
estingly, the model generates graphs that spontaneously 
develop a structural organization in which vertices with 
different degrees exhibits different level of local cluster- 
ing and correlations. These correlations can be shown to 



emerge as a direct consequence of the coupling between 
topology and dynamics. While the model we introduce 
here is possibly the simplest one in the class of weight- 
driven models, it generates a very rich phenomenology 
that captures many of the complex features emerging in 
the analysis of real networks. In this perspective it can be 
considered as a general starting point for more realistic 
models aimed at the representation of specific networks. 
The paper is structured as follows. In section ^ we 
review the necessary definitions and tools for the char- 
acterization of complex weighted networks. The general 
formulation of the model is reported in section IIIII Sec- 
tion IIVI discusses the homogeneous reinforcement rules 
and reports the corresponding analytical and numerical 
analysis. In Section the dynamics is generalized in or- 
der to include the effect of local randomness. A further 
generalization to a more complicate non-linear reinforce- 
ment mechanisms for the weights' evolution is discussed 
and analyzed in section IVTl 



II. WEIGHTED NETWORKS 

The topological properties of a graph are fully encoded 
in its adjacency matrix a^, whose elements are 1 if a 
link connects node i to node j, and otherwise. The 
indices i,j run from 1 to iV where N is the size of the 
network and we use the convention an = 0. Similarly, 
a weighted network is entirely described by a matrix W 
whose entry Wij gives the weight on the edge connecting 
the vertices i and j (and Wij = if the nodes i and j are 
not connected). In the following we will consider only the 
case of symmetric weights Wij = Wji while the directed 
case is considered in [21| . 

Important examples of weighted networks have been 
recently characterized. The first example is the world- 
wide airport network (WAN) [H [11 ill IH where the 
weight Wij is the number of available seats on direct 
flights connections between the airports i and j. A 
second important case-study is the scientific collabora- 
tion network (SCN) |2J, |23 where the nodes are identi- 
fied with authors and the weight depends on the num- 
ber of co-authored papers [Tl ^^. These two cases, 
which are paradigms of respectively large infrastructure 
and of social networks, display complex features char- 
acterized by heavy tailed distributions for topological 
and weighted quantities. Another very important ex- 
ample of a weighted network is the biochemical network 
of metabolic reactions. For this network, the nodes are 
biochemical elements (enzymes, etc) and a link between 
two nodes denotes the existence of an individual chemi- 
cal reaction between them. The weight of a link can be 
characterized by the flux of this chemical reaction. A 
very recent study [la| has provided the first analysis of 
the weighted graph of a metabolic network, bringing fur- 
ther evidence for the heterogeneous complex character of 
weighted networks. 

In the following we introduce a set of general quantities 



whose statistical analysis allows the mathematical char- 
acterization of the complex and heterogeneous nature of 
weighted graph. 



A. Weights and strength 

The most commonly used topological information 
about vertices is their degree and is defined as the num- 
ber ki of the neighbors 
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A natural generalization in the case of weighted networks 
is the strength Si defined as [ll [l^l 
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Indeed, the strength of a node combines the information 
about its connectivity and the intensity of the weights 
of its links. In the case of the world-wide airport net- 
work, the strength Si corresponds to the total traffic go- 
ing through a vertex i and is therefore an indication of 
the importance of the airport i. In the case of the scien- 
tific collaboration network, the strength gives the number 
of papers authored by a given scientist (excluding single- 
author publications, see e.g. [12]'). 

A natural characterization of the statistical properties 
of networks is provided by the probability P{k) that any 
given vertex has a degree k. Many studies have revealed 
that networks display a heavy tailed probability distri- 
bution P{k) that in many cases is well approximated by 
a power-law behavior P{k) ~ k~'^ with 2 < 7 < 3. This 
has led to the introduction of the class of scale-free net- 
works Iq], as opposed to the regular graphs with poisso- 
nian degree distribution. Similar information on the sta- 
tistical properties of weighted networks can be gathered 
at first instance by the analysis of the strength and weight 
distributions P{s) and P{w) which denote the probabil- 
ity of a vertex to have the strength s and of a link to have 
the weight w, respectively. Also for these distributions, 
recent measurements on weighted networks have uncov- 
ered the presence of heavy tails and power-law behaviors 
[H E 111 III El 113. The heavy-tailed behavior of 
these distributions is an extremely relevant characteristic 
of complex networks indicating the presence of statistical 
fluctuations diverging with the graph size. This implies 
that the average values (fc), (w), and (s) are not typical 
in the network and there is an appreciable probability of 
flnding vertices with very high degree and strength. In 
other words, we are generally facing networks which are 
very heterogeneous. It is worth stressing that the corre- 
lations between the weight and topological properties are 
encoded in the statistical relations among these quanti- 
ties. Indeed, s^, which is a sum over all neighbors of i, is 
correlated with its degree ki . In the simplest case of ran- 
dom, uncorrelated weights Wij with average < u; >, the 



strength is s ^< w > k. In the presence of correlations 
between weights and topology, we may observe a more 
complicated behavior with s ~ Ak^ with /? ^ 1 or with 
/3 = 1 and A ^< w >. 



B. Clustering and correlation 

Complex networks display an architecture imposed by 
the structural and administrative organization of these 
systems that is not fully characterized by the distribu- 
tions P{k) and P{s). Indeed, the structural organiza- 
tion of complex networks is mathematically encoded in 
the various correlations existing among the properties of 
different vertices. For this reason, a set of topological 
and weighted quantities are customarily studied in order 
to uncover the network architecture. A first and widely 
used quantity is given by the clustering of vertices. The 
clustering of a vertex i is defined as 
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and measures the local cohesiveness of the network in 
the neighborhood of the vertex. Indeed, it yields the 
fraction of inter-connected neighbors of a given vertex. 
The average over all vertices gives the network clustering 
coefficient which describes the statistics of the density 
of connected triples. Further information can be gath- 
ered by inspecting the average clustering coefficient C{k) 
restricted to classes of vertices with degree k: 
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In many networks, the degree-dependent clustering co- 
efficient C{k) is a decreasing function of k which shows 
that low-degree nodes generically belong to well intercon- 
nected communities while high-degree sites are linked to 
many nodes that may bel ong to different groups which 
are not directly connected 26, ^J\ . This is generally the 
signature of a non trivial architecture in which hubs, high 
degree vertices, play a distinct role in the network. 

Another important source of information lies in the 
correlations of the degree of neighboring vertices {2^, i23 ■ 
Since the whole conditional distribution P{k'\k) that a 
given site with degree k is connected to another site of 
degree k' is often difficult to interpret, the average near- 
est neighbor degree has been proposed to measure these 
correlations [2al 
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Once averaged over classes of vertices with connectivity 
k, the average nearest neighbor degree can be expressed 
as 



knn\k) — / ^ k y[k \k) , 



(6) 



providing a probe on the degree correlation function. If 
degrees of neighboring vertices are uncorrelated, P{k'\k) 
is only a function of k' and thus knn{k) is a constant. 
When correlations are present, two main classes of pos- 
sible correlations have been identified: assortative be- 
havior if knn{k) increases with fc, which indicates that 
large degree vertices are preferentially connected with 
other large degree vertices, and disassortative if fc„„(fc) 
decreases with k jSfl. 

While the above quantities provide clear signatures of 
the structural organization, they are defined solely on 
topological grounds and the inclusion of weights and 
their correlations might be extremely important for a 
full understanding of the networks' architecture. For in- 
stance, Fig.ndearly shows that very different situations 
in terms of weights can have the same topological cluster- 
ing: if the existing triples are formed by links with small 
weights, the (geometrical) clustering coefficient will over- 
estimate their relevance in the network's organization. 
For this reason, generalizations of clustering and correla- 
tions measurements to weighted networks have been put 
forward in J12l |. 

The weighted clustering coefficient of a vertex is defined 
as ^ 
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This quantity combines the measure of the existence of 
triples around vertex i with the intensity of the links em- 
anating from i and participating to these triples. As we 
show in Fig. ^ c^ describes more accurately than a the 
relevance of these triples. The normalization Si(ki — 1) 
corresponds to the maximum possible value of the nu- 
merator and thus ensures that c^ G [0, 1]. The average 
over all sites, or over sites of a given degree fc, define re- 
spectively the global weighted clustering coefficient C" 
and C'"{k). For random or uniform weights, these av- 
erages coincide with their geometrical counterparts. On 
the other hand, the comparison between C and C^ (and 
also between C(fc) and C""(fc)) conveys informations on 
the repartition of weights. A larger weighted clustering 
C™ > C signals that links with large weights have a ten- 
dency to form triples while the opposite case C™ < C 
signals a lower relevance of the triangles. 

Analogously, high degree vertices could be connected 
mainly to small degree vertices with a small intensity of 
connections and to few large degree vertices with large 
weights: a topological disassortative character is there- 
fore emerging while in term of interactions one would 
conclude to an assortative behavior. In the same spirit 
as for the clustering, one can therefore define the weighted 
average nearest neighbor degree as |l2l | 
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This quantity is the natural generalization of the usual 
assortativity knn,i and balances the nearest neighbor 




FIG. 1: Examples of local configurations whose topological 
and weighted quantities are different. Top: In both cases the 
central vertex (filled) has a very strong link with only one 
of its neighbors. Bottom: opposite situation. The weighted 
clustering and the weighted average nearest neighbors degree 
capture more precisely than their topological counterparts the 
effective level of cohesiveness and affinity due to the actual 
interaction intensity as measured by the weights. 



degree with the normalized weight of the connecting 
edge Wij/si. It reduces to knn,i for uniform or random 
weights. Comparing kf^^ ^ with knn,i informs us if the 
larger weights point to the neighbors with larger degree 
(if fc™„ j > knns) or on the contrary to the ones with 
smaller degree (see Fig.P). The behavior of k'^^{k), thus 
measures the effective affinity to connect with high or 
low degree neighbors according to the magnitude of the 
actual interactions. 

In the following we will make use of all these quantities 
in order to provide a throughout characterization of the 
weighted graphs generated by our model and to assess the 
relevance of the weights in their structural organization. 



III. THE MODEL 

Previous models of weighted growing networks [isL Il9l | 
were considering the growth as driven by the topologi- 
cal features only, with weights statically assigned to the 
links; i.e. Wij is chosen at the creation of the link i ~ j 
and does not evolve afterwards. This mechanism leads 
to topological heterogeneities, however it lacks any dy- 
namical feature of the network's weights. Indeed, it is 
rather intuitive to consider that the addition of new ver- 
tices and links will perturb, at least locally, the existing 
weights. This phenomenon can be easily understood by 
considering the example of the airline network: a new air- 
line connection arriving at airport A will generally mod- 
ify (increase) the traffic activity between airport A and 
its neighboring airports. Passengers brought by the new 
connection will eventually get on connection flights, in- 



creasing the passenger flow on the other routes. In the 
Internet as well, it is easy to realize that the introduc- 
tion of a new connection to a router corresponds to an 
increase in the traffic handled on the other router's links. 
Indeed in many technological, large infrastructure and 
social networks we are generally led to think about a rein- 
forcement of the weights due to the network's growth. In 
this spirit we consider here a model for growing weighted 
network that takes into account the coupled evolution in 
time of topology and weights 0| and leaves room for ac- 
commodating different mechanisms for the reinforcement 
of interactions. 

The definition of the model is based on two coupled 
mechanisms: the topological growth and the weights' dy- 
namics. 

(i) Growth. Starting from an initial seed of Nq vertices 
connected by links with assigned weight wq, a new vertex 
n is added at each time step. This new site is connected 
to m previously existing vertices, choosing preferentially 
sites with large strength; i.e. a node i is chosen according 
to the probability 
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This rule, of strength driven attachment, generalizes the 
usual preferential attachment mechanism driven by the 
topology, to weighted networks. Here, new vertices con- 
nect more likely to vertices which are more central in 
terms of the strength of interactions. 

(ii) Weights ' dynamics. The weight of each new edge 
(n, i) is initially set to a given value wq. The creation of 
this edge will introduce variations of the traffic across the 
network. For the sake of simplicity we limit ourselves to 
the case where the introduction of a new edge on node i 
will trigger only local rearrangements of weights on the 
existing neighbors j £ V(i), according to the rule 
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(10) 



where in general Awy depends on the local dynamics 
and can be a function of different parameters such as the 
weight my, the connectivity or the strength of i, etc. In 
the following we focus on the case where the addition of 
a new edge with weight wq induces a total increase 5i of 
the total outgoing traffic and where this perturbation is 
proportionally distributed among the edges according to 
their weights [see Fig. ^] 
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This rule yields a total strength increase for node i of 
6i + Wo, implying that Si -^ s,; + Si + wq. After the 
weights have been updated, the growth process is iterated 
by introducing a new vertex, i.e. going back to step (i) 
until the desired size of the network is reached. 

The mechanisms (i) and (ii) have simple physical and 
realistic interpretations. Equation (Q corresponds to the 
fact that new sites try to connect to existing vertices with 
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FIG. 2: Illustration of the construction rule. A new node 
n connects to a node i with probability proportional to 
Sif^. Sj. The weight of the new edge is wo and the total 
weight on the existing edges connected to i is modified by an 
amount equal to Si. 



the largest strength. This is a plausible mechanism in 
many real world networks. For instance, in the Internet 
new routers connect to routers that have larger band- 
width and traffic handling capabilities. In the case of the 
airport's networks, new connections are generally estab- 
lished to airports with a large passenger traffic. In con- 
trast to the connectivity preferential attachment of the 
"rich get richer" type, the mechanism here relies on the 
importance of the traffic and could be more adequately 
described as "busy get busier" . At the same time, the 
weights' dynamics Eqs. H10lll() couples the addition of 
new edges and vertices with the evolution of weight and 
strength and correspond to different scenarios according 
to the value of Si: 

• for Si < wq, the new link has not a large influ- 
ence. This may be the case for scientific collabo- 
rations where the birth of a new collaboration (co- 
authorship) is very likely not going to strengthen 
the activity on previous collaborations. 

• Si ~ wq corresponds to situations for which the new 
created traffic (on the new link n — i) is transferred 
onto the already existing connections in a "conser- 
vative" way. 

• Si > wq is an extreme case in which a new edge gen- 
erates a sort of multiplicative effect that is bursting 
the weight or traffic on neighbors. 

The quantity wo sets the scale of the weights and we 
can therefore use the rescaled quantities Wij/wo, Si/wo 
and Si/uiQ, or equivalently set wq = 1. The model then 
depends only on the dimensionless parameter Si. The 
generalization to arbitrary wq is simply obtained by re- 
placing Si, Wij and Si respectively by Si/wo, Wij/wo and 
Si/wQ in all results. 

The model is very general and the properties obtained 
for the generated networks will strongly depend on the 
kind of coupling between topology and weights as speci- 
fied by the parameter Si and its variations depending on 
the vertex' properties. In the following we will provide 



analytical and numerical inspections of three prototypical 
situations that can be used as starting points for further 
generalizations. 



IV. HOMOGENEOUS COUPLING 

In this section, we will focus on the simplest form of 
coupling with Si = S = const. This case amounts to a 
very homogeneous system in which all the vertices have 
an identical coupling between the addition of new edges 
and the corresponding weights' increase. Such a growing 
model can be analytically studied through the time evo- 
lution of the average value of Si (t) and ki (t) of the i-th 
vertex at time t, neglecting fluctuations and thus work- 
ing at a "mean-field" level. In addition, we use numerical 
simulations in order to provide a direct statistical analy- 
sis of the generated graph and substantiate the analytical 
findings. 



A. Evolution of strength and weights 

The network growth starts from an initial seed of Nq 
nodes, and continues with the addition of one node per 
unit time, until a size N is reached. When a new edge n 
is added to the network, an already present vertex i can 
be affected in two ways: i) It is chosen with probability 
© to be connected to n; then its connectivity increases 
by 1, and its strength by 1 -|- i5. ii) One of its neighbors 
j e V{i) is chosen to be connected to n. Then the connec- 
tivity of i is not modified but Wij is increased according 
to the rule Eq. H10|l . and thus Si is increased by Swij/sj. 
This dynamical process modulated by the respective oc- 
currence probabilities Si(i)/^; s;(t) and Sj{t)/J2i^ii't) 
is thus described by the following evolution equations for 
Si and ki 
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where we have considered the continuous approximation 
that treats fc, s and the time t as continuous variables [l|, 
y|. These equations may be written in a more compact 
form by noticing that the addition of a node results in the 
addition of m links obtaining that the total degree at time 
t is given by X]j=i ^i(0 ~ 2rMt. Similarly, each added link 
increases the total strength by an amount equal to 2 + 2(5, 
obtaining 



^s^{t) Ki2m{l + S)t 



(13) 
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FIG. 3: Evolution of the strength of vertices during the 
growth of the network, for various values of S; The thick lines 
are the predicted power laws t" , a = {l + 2S)/{2 + 25) (m — 2, 
A^ = 10'*). 



By plugging this result into the equations (|12|l . we obtain 
the following dynamical equations 

dsj 

dt 

dki 

~dt 
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These equations can be readily integrated with initial 



conditions ki{t = i) = Si{t = i) — m, yielding 
Si{t) = m 
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The strength and degree of vertices are thus related by 
the following expression 



s, = (26 + l)fc, - 2md 



(17) 



that implies a proportionality between strength and de- 
gree. It is worth noticing, however, that this relation in- 
dicates the existence of correlations that are not present 
in the case of randomly assigned weights. Indeed, at 
each new link created the sum of weights is incremented 
by 1 + (5 and therefore < w >= 1 + S. As previously 
mentioned, a random assignment of weights would then 
lead to Si = ki{l + S). The equation H17|) instead re- 
veals a different proportionality constant signaling corre- 
lations between the two quantities. The proportionality 
relation s ~ fc also indicates that the weight-driven dy- 
namics generates in Eq. (|5J) an effective degree preferen- 
tial attachment. This model thus displays a microscopic 
mechanism accounting for the presence of the preferential 
attachment dynamics in growing networks. 

In order to check the analytical predictions we per- 
formed numerical simulations of networks generated by 



using the present model with different values of S, mini- 
mum degree m and varying network size N. In Fig.|21we 
show the behavior of the vertices' strength versus time 
for different values of S, recovering the behavior predicted 
analytically. We also report the average strength Si of 
vertices with degree ki and confirm that f3 — 1 as well as 
the validity of Eq. lfT7|) as shown in Fig. ^ 

The time evolution of the weights Wij can also be com- 
puted analytically along the lines used for the study of 
Si{t) and ki{t). Indeed, Wij evolves each time a new node 
connects to either i or j and the corresponding evolution 
equation can be written as 



dwij 
~dt 
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The link {i,j) is created at i^ = max(i,_;/) with initial 
condition Wij (Uj ) = 1 , so that 
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At fixed time i, this result implies that 
Wtj{t) -^mm{i,j)^TT . 

2^ + 1 

and since ki(t) ~ i 24+2 ^ we obtain 

Wij ^ nim(ki, kj) 2*+i . 
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(20) 
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In this case also, the numerical simulations of the 
model reproduce the behaviors predicted by the analyt- 
ical calculations. The time evolution of some randomly 
chosen weights is displayed in Fig.|Sland compared with 
the prediction of Eq. (|19|) . For the sake of completeness 
we show in Fig. the validity of Eq. H21|) for the cor- 
relation between Wij and the connectivities of i and j. 



B. Probability distributions 

The knowledge of the time-evolution of the various 
quantities allows us to compute their statistical proper- 
ties. Indeed, the time ti = i at which the node i enters 
the network is uniformly distributed in [0,t] and the de- 
gree probability distribution can be written as 



P{k,t) = 
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(22) 



where 6{x) is the Dirac delta function. Using equation 
ki{t) ^ {t/iY obtained from Eqs. IjlSIKil) one obtains in 
the infinite size limit t —t 00 the distribution P{k) ^ k^"' 
with 7 = 1 + l/a: 
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FIG. 4: Strength Si versus ki for m = 8 and for various values 
of (5 (A'' = 10^, data averaged over 1000 samples). The dashed 
hues are the predictions of Eq. 11171 : Si — [1 + 25)ki — 2mS. 



FIG. 6: Wij vs. min(fei,fcj); the dashed lines are the theoret- 



ical predictions (m 
samples) . 



8, N = 10*, data averaged over 1000 




FIG. 5: Time evolution of Wij during the growth of the net- 
work, for different values of S. The functional behavior is 
consistent with the predicted power law i*", 6 — S/{1 + S), 
shown as dashed lines. Data are averaged over 200 networks 
with m = 2 and TV = 10*. 



new links. 

The weight distribution P(w) can be analogously cal- 
culated yielding the power-law behavior 



P{w) 



a = 2 



(24) 



The distribution P{w) therefore is even more sensitive 
to the parameter S and evolves from a delta function for 
(5 = (no evolution of the weights) to a very broad power- 
law as (5 — ^ 00. The value 6 = 1 corresponds to a = 3, i.e. 
to the boundary between finite and unbounded fluctua- 
tions of the weights. In Fig. |S1 the weight distributions 
obtained from numerical simulations at different values of 
the parameter 6 are reported along with the comparison 
between the values of the measured exponent a and the 
analytical prediction. The precise microscopic dynam- 
ics ruling the network's growth and the rearrangement of 
weights is therefore very relevant to the final distribution 
of weights, even if it affects only in a much milder way 
degree and strength. 



Since s and k are proportional, the same behavior P{s) ^ 
s~'^ is obtained for the strength distribution. P{s) is 
displayed in Fig. [7| showing that the obtained graph is 
a scale-free network both for topology and strength and 
described by an exponent 7 G [2, 3] that depends on the 
value of the parameter S. As expected, if the addition 
of a new edge does not affect the existing weights {S = 
0), we recover the Barabasi- Albert model Iq] with the 
value 7 = 3. As S increases, the distributions get broader 
with 7 — > 2 when S — > cx), i.e. in a range of values 
usually observed in the empirical analysis of networked 
structures 0,l3il3- This result could be an explanation of 
the lack in real-world networks of any universality of the 
degree distribution exponent. Our model indeed predicts 
that all the exponents will be non-universal and depend 
on the local processes which take place at nodes receiving 



C. Correlations and clustering 

The previous analytical study of the model does not 
provide information on the correlations generated by the 
growing process. In order to have a direct inspection of 
these properties we therefore consider the graphs gener- 
ated by the model for different values of S, m and N and 
measure the quantities defined in section^ that charac- 
terize the clustering and correlation properties. 

The model exhibits also in this case properties which 
are depending on the basic parameter S. More precisely, 
for small 5, the average nearest neighbor degree knn{k) 
is quite flat as in the BA model. The disassortative char- 
acter emerges as 5 increases and gives rise to a power 
law behavior of knn(k) ~ fc~° as shown in Fig. |5| |31| . 
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FIG. 7: Probability distribution P{s). Data are consistent 
with a power-law behavior s~^. In the inset we report the 
value of 7 obtained by data fitting (filled circles), together 
with the analytic expression 7 = (3 + 45)/ (1 + 25) (line). The 
data are averaged over 200 networks of size A'^ — lO'' . 
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In the inset we report the value of a obtained by data fitting 
(filled circles) and the analytic expression a = 2 + 1/(5 (solid 
fine). The data are averaged over 200 networks of size A'^ = 
10^ 



Remarkably, the weighted average nearest neighbor de- 
gree displays for any S a flat behavior. Moreover, as in 
recently studied real networks, k'^„{k) > /c„„(fc) which 
indicates that the larger weights contribute to the links 
towards vertices with larger connectivities. This behav- 
ior, also obtained in real weighted networks, is shown in 
Fig.m 

Analogous properties are obtained for the clustering 
spectrum. At small S, the clustering coefficient of the 
network is small and C{k) is flat. As 6 increases how- 
ever, the global clustering coefficient increases and C(fc) 
becomes a decreasing power-law similar to real networks 
data ^2] . Fig. (|10|) clearly shows that the increase in clus- 
tering is determined by small k vertices. The weighted 



FIG. 9: m = 2; Top: k„„(k) and k^„{k) for (5 = 2; bottom: 
m = 2; evolution of knn{k) for increasing 5. 
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FIG. 10: m = 2; Top: C{k), C"'(fc) for 5 = 2; bottom: C{k) 
for various 5. 



clustering C™ also increases and is larger than the topo- 
logical C, with an essentially flat C™{k). Especially at 
large fc, it is clear that the usual clustering coefficient 
underestimates the importance of triples in the network 
since, for the hubs, the edges with the highest weights be- 
long in great part to the interconnected triples. In other 
words, interconnected vertices are joined by edges that 
have weights larger than the average value found in the 
network. 

Interestingly, correlations and clustering spectrum can 
be qualitatively understood by considering the dynamical 
process leading to the formation of the network. Indeed, 
vertices with large connectivities and strengths are the 
ones that entered the system at the early times as shown 
by equations H15I16|) . Newly arriving vertices attach to 
pre-existing vertices with large strength which on their 
turn are reinforced by the rearrangement of the weights. 
This process naturally builds up a hierarchy among the 
nodes: "old" vertices have neighbors that are more likely 
to be "young" i.e. with small connectivity. On the con- 



trary, newly arriving vertices on the contrary have neigh- 
bors with high degree and strength, generally leading to 
a disassortative behavior. This effect gets stronger as 
6 increases and P{k) broadens leading to disassortative 
properties. As well, edges among "old" vertices are the 
ones that gets more reinforced by the weights dynam- 
ics indicating that the edges between older nodes, with 
large connectivities will be typically stronger than the 
average. This means that the weighted assortativity will 
be larger than the topological assortativity, leading to 
^nn(^) > knn{k), especially for large k. 

Similarly, the increase of C with 5 is also directly re- 
lated to the mechanism which rearranges the weights 
after the addition of a new edge. Since vertices with 
large strength and degree are generally connected among 
them, a new vertex has more probability to attach to the 
extremities of a given edge. Triangles will typically be 
made of two "old" nodes and a "young" one. therefore 
C{k) increases faster for "younger" (low degree) nodes 
when 5 increases generating the observed spectrum. On 
the other hand, the edges between "old" and "young" 
vertices are the most recent ones and do not have large 
weights. This feature implies that for low degree ver- 
tices Ci and cf are rather close. In contrast, high degree 
vertices are connected to each other by edges with large 
weights, leading to a weighted clustering coefhcient larger 
than the topological one. 

These qualitative arguments confirm the importance of 
considering weighted correlations since topological corre- 
lations do not fully reveal the intrinsic coupling between 
topology and weights, that may lead to very different 
behavior of the correlation and clustering spectrum. 



V. HETEROGENEOUS COUPLING 

In the model described in the previous section as well 
as in most models of growing networks, connectivities 
and strengths of different vertices grow with the same 
exponent (see Eq. \i^ ). Therefore, vertices entering the 
system at the early times have always the largest connec- 
tivities and strengths. One can however imagine that a 
newly arriving vertex has intrinsic properties which make 
it more attractive than older ones so that its connectiv- 
ity and strength could grow faster than its predecessors. 
This feature is certainly very important in many real sys- 
tems where individuals are not identical and has been 
P forward in the so-called fitness model |33] [see also 
for a static definition of a fitness model]. In a very 
similar spirit, we introduce here a node-dependent 5i im- 
plying that the perturbation of weights created by any 
new edge attached to the node i will depend on the very 
local properties of i. This amounts to introduce a general 
heterogeneity in the dynamical properties of the elements 
of the system. 

In this case, each vertex entering the system is tagged 
with its own 5i that we will assume are independent ran- 
dom variables taken from a given distribution p{5) char- 



acterizing the system's heterogeneity. The preferential 
attachment (Eq. I^J is not modified and the redistribu- 
tion of weights now reads 



IXWij = di 



(25) 



A large value of 5i does not favor immediately the attrac- 
tiveness of the vertex but the addition of a new link to i 
modifies its total strength by a large amount 

Si -^ Si+WQ + 5i. (26) 

On the long run, larger 5i yield therefore larger increases 
Asi when i is chosen for the addition of a new edge. Since 
the model's dynamics is driven by a strength driven at- 
tachment the vertices with larger 5i will be progressively 
favored in the establishment of new connections, there- 
fore achieving a faster degree and strength growth as time 
goes by. 

Similarly to the homogeneous model of the previous 
section, the evolution equations of Si and ki can be writ- 
ten as 

dsi 






E 






dki 
~dt 



S^{t) 



where now the explicit dependence from the specific Si of 
each vertex is properly considered. For each newly added 
edge from the vertex n to the existing vertex i, X^i -^j i^ 
increased by 2+2Si. On the average it is therefore natural 
to consider that the total strength is increasing linearly 
with time as 



t 

E' 



i{t) ~2m{l + S')t 



(28) 



We assume that S' is a well defined constant, which is cer- 
tainly the case if p{6) is bounded. It is worth remarking 
that S' 7^< S > since during the growth process, vertices 
with larger 6i will be preferentially chosen. The quan- 
tity 5' will be determined self-consistently by the general 
solution. 

We use Eq. (|28|l in the evolution Eqs. (|27|l and since 
'^iev(i) "^ij^j i^ ^ sum over the neighbors of i that are 
chosen by the strength driven dynamics, we assume that 



obtain 



S' and therefore J2 



iev(j) ^y"i 



We then 



dst 
H 
dki 
~dt 



8, + 5' + ls,{t) 
25' + 2 
s^{t) 



t 



(29) 



2{l + 5')t 

The integration of these equations with the initial condi 
tions ki(t = i) = Si{t = i) = m yields 

't 



■s^it) 

h{t) 



s,{t) + m{5^ + 5') 
5^ + 5' + \ 



(30) 
(31) 
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The strength and degree of the vertices therefore grow 
as power-laws, with an exponent that depends on their 
abihty to redistribute weights: 



1 



2(1 + ^') 



(32) 



Equation (|3 II thus shows that also in the heterogeneous 
model the strength and connectivity are proportional, 
with a coefficient depending on 6i 



h{l + S, + 5')-m{S, + 5') 



(33) 



The knowledge of the time behavior of Si{t) makes it 
possible to obtain the probability distribution of connec- 
tivities and strengths. For example the distribution of 
strengths can be written as 



Psis^t) 



dSp{S) 



1 



t + NoJo 



6{s - Si{t))dU 



(34) 



where 5{s — Si{t)) is the Dirac delta function (not to 
be confused with the heterogeneity parameter). Since 

Si{t) oc (t/ti)"-'-^^ we obtain 



P{s) ex / dS 



a{S) 



l/a(5) + l 



(35) 



which shows that the precise form of P{s) depends on 
p{d). Finally, the proportionality of ki and Si ensures 
that their distributions have the same form. 

Along the same lines we can obtain the dynamical evo- 
lution of the weights. Indeed, Wij grows each time a new 
node connects to either i or j, its evolution equation be- 
ing 



dwij 
"df 



E/Si 






^7 r '^ij 



2{l + 6') t 

This readily implies that Wij (t) oc t^^^ with 

5, + Sj 
''^ 2{l + S')- 



(36) 



(37) 



The behavior of the model depends explicitly on 
the value 6', that has to be self-consistently deter- 
mined. The consistency of the solution is obtained using 
Eqs. (|^OI:^ll^l^|l which give 



t 

E 



S^{t) 



dSp{6) 



dtom — 
1 V^o 



a{S) 



dSp{S) 



t ~ f^f*) 

l-a((5) 



(38) 



with a{5) = {I + 5 + 5')/{2{l + 5')). Since Si cannot 
grow faster than i, a{5) has to be less than 1 and using 
Eq. (|28|l . we obtain from Eq. H38|l in the large time limit 



277l(l + 6') = 



dSp{S) 

l+S+5' 
2(l+<5') 



(39) 
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FIG. 11: Model with random Si: evolution of Si/m for a given 
node i with various values of its redistribution parameter Si . 
m — 2, N = 10 , average over 1000 networks with the same 
realization of Sj G [0; 2] {j ^ i). The dashed lines correspond 
to the predicted power-laws (t/i)"'^ •'. 



or 



dSpjS) 
1 + 5' - 



1 



(40) 



which determines the value of 6' . Finally, we note that 
these results are valid only if the quantity Si is bounded: 
if it is not the case, the basic assumption that J2i ^i grows 
linearly is no longer true p33 | . 

It is clear from the above solution that the graph's 
properties will depend upon the particular form of the 
coupling distribution p{5). In order to compare with nu- 
merical simulations of the model we analyze the specific 
case of a uniform distribution p{6) in the interval between 
6min and Smax- The equation for 6' can be explicitly 
solved, obtaining 



S' 



[S. 



1) exp((5„ 



1 



cxp((5„ 



0-1 



(41) 



We are therefore in the position to provide an explicit 
value of the exponent a(6) for the evolution of s and 
k during the growth of the network. Similarly, the 
strength probability distribution can be written as 



P{s) ex 



da nn\ i+i/a 



a \ s J 



whose behavior at large s is: 



P{s) oc 



,l-|-l/a„ 



log(s) 



(42) 



(43) 



where a„iax = (1 + 6max + '5')/(2(l + S')) is the largest 
possible value of the exponent a{5). 

A test of the analytical results is obtained by the direct 
inspection of networks obtained by numerical simulations 
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FIG. 12: Model with random Si: evolution of Si for various 
nodes, m — 2, N — 10^. Symbols: results of numerical simu- 
lations, average over 1000 networks with the same realization 
of 5j £ [1;3]. Nodes arriving later can overcome younger 
nodes. Lines are the prediction I3UII with the exponent given 
by lEU and igTJ- 
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FIG. 13: Model with random Si: distribution of strengths 
P{s) for uniform distributions p{S), Sj € [0; 1] and Sj £ 
[0;4]. Dashed lines are the theoretical predictions I43II 
g-i-i/a„„,^j^g^^-| ^ ^ -j^qS j^ ^ 2, average over 1000 
realizations. 



of the model in the case of heterogenous coupling. In par- 
ticular we consider networks generated by uniform distri- 
bution of the coupling constants in specific intervals as 
reported in the figure captions. The striking agreement 
of the analytical predictions [Eqs. H3QI32l41|l ] with the 
numerical results is shown in Figs. llll and ll2l It is worth 
noticing the remarkable agreement shown in these fig- 
ures, obtained without any free parameter. The statis- 
tical distributions of the quantities of interest are also in 
good agreement with the analytical prediction as shown 
in Fig.^]for the strength distribution. Finally, as shown 
in Fig. 1141 the correlation and clustering properties are 
non-trivial as well. As in the case of the homogeneous 
coupling the average nearest neighbors degree and the 



FIG. 14: TTi = 2; Top: k„„{k) and k™„{k) for a uniform dis- 
tribution p{S) with Sj e [0;0.4]; Bottom: 
distributions p(S) in various intervals [S 



knn(k) for uniform 

Sr, 



mm , '^max \ 



clustering coefficient have a clear structure with a hier- 
archical ordering of high and low degree vertices. Also in 
this situation the inclusion of weights in the characteri- 
zation of correlations provide additional information on 
the structure of the network. While more cumbersome 
because of the heterogeneous nature of the coupling, a 
general understanding of the observed properties can be 
obtained along the reasoning reported for the homoge- 
neous coupling model; in all cases, the dynamical growth 
process itself is at the origin of the complex architecture 
and structure of the generated networks. 



VI. NON-LINEAR COUPLING 

In the previous sections we considered the coupling 
term 5i as independent of the topological and weight 
properties of the vertex i. We can however think of dif- 
ferent situations in which the perturbation depends on 
the centrality of the node as measured by its strength or 
degree. In the airline network, for example, this might 
mimic the fact that larger is the airport and larger is 
the increase of traffic with a much larger response to the 
creation of a new connection compared to a small air- 
port. It is thus natural to investigate the consequence of 
non-linear coupling forms. 

The simplest non-linear coupling consists in consider- 
ing that Si is proportional to Si . In order to avoid unreal- 
istic divergences a cut-off sq is however needed to bound 
the coupling, leading to the reinforcement rule 



Aw, 



S^ 



So tanh 



So 



(44) 



This relation simply expresses that the larger the traffic 
on the vertex i and the larger will be the traffic attracted 
to it during the weights' dynamics. The total change in 
Si when a link is added is now (5[so tanh(si/so)]"- For 
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FIG. 15: N = 5000; so = lO''. s vs A; for a = 0.2, 0.4, 0.6, 0.8. 
Dashed lines have slope 1.07, 1.21, 1.25 and 1.34 (from bottom 
to top). For values of s larger than so there is a crossover 
towards /3 = 1. 



FIG. 16: N = 5000; so = lO''. P{s) and P{k) for a = 0.8, 
5 = 0.1. The data for P{k) have been shifted vertically for 
clarity. Continuous and dashed lines correspond to the power 
laws fc"^'^^ and s~^'^ respectively. 



strength smaller than the cutoff sq, this change grows as 
s°, and saturates to 6sq for very large strengths. 

The nonlinear mechanism makes the analytical solu- 
tion very difficult to find and we rely on a numerical study 
of the model to inspect its topological and weight proper- 
ties. We find that ^ Si{t) now grows faster than i, seem- 
ingly like exp(i''). Analogously, we observe that vertices' 
degree and the strength grow faster than simple power- 
laws. Very interestingly, we observe that the strength 
grows as a power-law with the connectivity, s ^ k^ with 
/3 > 1, as shown from the numerical simulations reported 
in Fig. E] The exponent /3 increases with a but it is 
independent from 5. This result raises the possibility 
that some real- world networks, in which a value /3 > 1 is 
observed, are governed by local non-linear reinforcement 
processes. This could be the case for the airport network 
where /3 ~ 1.5 is observed [T3|- 

An interesting consequence is then observed for the de- 
gree and strength probability distribution. While both 
distributions still behave as power laws, P{k) ~ k"'^'' 
and P{s) ^ s^''" , as shown in Fig. 1161 they exhibit dif- 
ferent exponents 7s and "fk > 7s in contrast with all the 
situations considered previously where we found 7^ — jk- 
This is obviously linked to the fact that /3 ^ 1 and it is 
not difficult to show that 



7s 



(3 (3 



1 



(45) 



The weight distribution P(w) is also power-law dis- 
tributed and in addition, all distributions get broader 
as either a ot 6 are increased. Finally, we note that the 
correlations and clustering properties exhibit also in this 
case non-trivial spectrum as a function of the degree fc, 
signalling the presence of a hierarchical architecture also 
in the presence of a non-linear coupling. 

It is clear that the results obtained for non-linear cou- 
pling mechanisms are depending upon the detailed form 



of the coupling and further studies are needed in order 
to understand the variations of time behavior and dis- 
tribution exponents as a function of the various param- 
eters defining the reinforcement dynamics. Obviously, a 
detailed study of all non-linear coupling mechanisms is 
impossible and each modeling effort must be driven by 
specific insights on the dynamics of the real systems un- 
der examination. 



VII. CONCLUSIONS 

In this paper we have presented a general model of 
growing networks that considers the effect of the cou- 
pling between topology and weights dynamics. We inves- 
tigated in details several coupling mechanisms including 
the effect of randomness and non-linearity in the redis- 
tribution process. 

The model produces graphs which display non trivial 
complex and scale-free behavior that depend on the de- 
tailed coupling form. In particular, different quantities 
such as strength, degree and weights are distributed ac- 
cording to power-laws with exponents which are not uni- 
versal and depend on the specific parameters that con- 
trol the local microscopic weights' dynamics. This result 
hints to a simple explanation of the lack of any univer- 
sality observed in real-world networks. In addition, the 
dynamics generates spontaneously a non-trivial architec- 
ture in which nodes with different degrees are arranged in 
a hierarchical way as indicated by the clustering and cor- 
relation properties measured in the obtained networks. 

While many other parameters and dynamical features 
may be entering the dynamics of real- world networks, we 
believe that the present model might provide a general 
starting point for the realistic modeling of several systems 
where the interplay of topology and traffic is a key point 
in the determination of the global network's properties. 
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